System and method for increasing clarity and expressiveness in network communications

ABSTRACT

Embodiments for increasing clarity and expressiveness in network communications include: obtaining a message from a first user as part of a network-enabled conversation with a second user; applying at least one embellishment to the message to produce an embellished message, the embellishment including either an explicitly user-selected embellishment or an automatically generated embellishment based on content of the message; and causing transmission of the embellished message via a network to the second user. Embodiments include: receiving a message from a first user via a network, the message including configuration data for configuring embellishment properties of the message; decoding the configuration data and generating an embellished message with the corresponding embellishment properties, the embellishment properties including either an explicitly user-selected embellishment or an automatically generated embellishment based on content of the message; and displaying the embellished message for the second user as part of a network-enabled conversation with the first user.

TECHNICAL FIELD

This application relates to a system and method for use with networkedentities, according to one embodiment, and more specifically, a systemand method for increasing clarity and expressiveness in networkcommunications.

COPYRIGHT

A portion of the disclosure of this patent document contains material,that is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction of the patent document or thepatent disclosure, as it appears in the Patent and Trademark Officepatent files or records, but otherwise reserves all copyright rightswhatsoever. The following notice applies to the software and data asdescribed below and in the drawings that form a part of this document:Copyright 2011-2012 IMVU, Inc., All Rights Reserved.

BACKGROUND

With the promulgation of connected devices, text-based communication hasincreased in importance over the last several decades. Examples oftext-based chat used on devices that are sometimes or always onlineinclude mobile phone Short Messaging Services (SMS) and MultimediaMessaging Services (MMS), Online Chat, the Internet Relay Chat network,e-mail and avatar-based chat applications like IMVU.com, and textbroadcasting/status updating services like Twitter and Facebook.

Text-based chat can be based on a synchronous, interactive dialog, orcan be based on an asynchronous dialog, such as through mobile phone SMSmessages, Twitter, online forums, or e-mail. The difference betweensynchronous and asynchronous communications is that, in synchronouscommunications, both sender and receiver of a message must be connectedto the messaging exchange at the same time, whereas with asynchronousmessaging, a sender leaves a message in storage, which is laterretrieved and interpreted by the recipient. The best asynchronousmessaging systems, such as SMS and Twitter, may appear close tosynchronous in nature, because they support, communication latencies ofas low as a few seconds, but the technology is still asynchronous andthere are limitations to the interactivity afforded by asynchronouscommunication implementations.

Because of limitations inherent in text transmission, conventions haveevolved to express states of mind, the difference between joking andseriousness, and short-hand for various kinds of common expressions.However, these conventions have not sufficiently improved thelimitations inherent in conventional text transmission.

BRIEF DESCRIPTION OF THE DRAWINGS

The various embodiments is illustrated by way of example, and not by wayof limitation, in the figures of the accompanying drawings in which:

FIG. 1 illustrates a conversation in a 3D avatar-based environment, withchat messages framed as chat bubbles and participants framed as avatars;

FIG. 2 illustrates a conversation in a 2D chat-based environment, withchat messages framed as chat, bubbles, and participants framed as small2D images;

FIG. 3 illustrates a conversation in a 2D asynchronous messagingenvironment, with chat messages framed as separate panels of text, andparticipants framed as small 2D images;

FIG. 4 illustrates an expressive/embellished conversation between threeparticipants in an example embodiment;

FIG. 5 illustrates an alternative embodiment using different visual,styles;

FIG. 6 illustrates the emoticon composition interface in an exampleembodiment;

FIGS. 7 through 12 illustrate examples of animated emoticons availablein various embodiments;

FIG. 13 illustrates an example of an online catalog listing avataractions or items provided by the compose message processing component ofan example embodiment;

FIG. 14 illustrates the process of selecting recipients and/or contextfor the message's in an example embodiment;

FIG. 15 illustrates the process of composing messages in an exampleembodiment;

FIG. 16 illustrates the process of embellishing messages in an exampleembodiment;

FIG. 17 illustrates the process of transmitting, storing, and forwardingmessages to recipient/s in an example embodiment;

FIG. 18 illustrates the process of receiving messages in an exampleembodiment;

FIGS. 19 and 20 illustrate the process of displaying received messagesin the context of other messages in an example embodiment;

FIG. 21 illustrates the process of browsing and (re-)reviewing messagesin an example embodiment;

FIG. 22 illustrates an example embodiment of a system and method forincreasing clarity and expressiveness in network communications;

FIG. 23 illustrates another example embodiment of a networked system inwhich various embodiments may operate;

FIGS. 24 and 25 are processing flow diagrams illustrating exampleembodiments of the message processing performed in a message processingsystem as described herein; and

FIG. 26 shows a diagrammatic representation of machine in the exampleform of a computer system within which a set of instructions whenexecuted may cause the machine to perform any one or more of themethodologies discussed herein.

DETAILED DESCRIPTION

In the following description, for purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of the various embodiments. It will be evident, however,to one of ordinary skill in the art that the various embodiments may bepracticed without these specific details.

Background of Various Example Embodiments

FIG. 1 shows a conversation in a 3D avatar-based environment, with chatmessages framed as chat bubbles and participants framed as avatars in aconventional system.

FIG. 2 shows a conversation in a 2D chat-based environment, with chatmessages framed as chat bubbles, and participants framed as small 2Dimages in a conventional system, “Emoticons,” short textualrepresentations of emotional or situational intent, are translated tosmall 2D images.

FIG. 3 shows a conversation in a 2D asynchronous messaging environment,with chat messages framed as separate panels of text, and participantsframed as small 2D images in a conventional system. “Emoticons” aretransmitted verbatim, such as the sideways sad face shown in message 55m in FIG. 3. Users have to be trained to understand these textual-visualrepresentations.

In a real personal interaction, the reactions and responses of thepeople involved are an important part of the communication. This part ofreal personal interaction is generally not captured well by the existingstate of the art. Avatar-based communication systems, such as IMVU.com(IMVU is a trademark of IMVU, Inc.), have responded to this need byallowing participants to communicate animations in addition toemoticons. Such animations are immediately visible to all participantsin the communications session; but, once played out, such animations aregone and not generally visible in the textual history of thecommunication. Additionally, such avatar-based communications only workwhen the interaction is synchronous.

The history of a textual conversation is generally displayed as ascrollable list of related messages. To refer to previous parts of theconversation, or previous conversations, the user reads the text. Forsystems that use avatar-based chat, this log does not capture thetotality of the conversation, because avatars that were in the scene andmay have animated during the chat, are doing something else at the timeof review—or may no longer even be in the scene.

In the marketplace, the existing asynchronous mechanisms suffer from alack of differentiation. Communications through one asynchronoustext-based messaging system feels very similar in all the availableproducts. This leads to a lack of ability with the systems operator tocapture value from users of a system, other than trying to injectadvertising or other similar external, extrinsic monetization, which maybe resented by users.

Description of Various Example Embodiments

An example embodiment is illustrated in FIG. 4, which depicts anexpressive/embellished conversation between three participants. Theconversation and images are composed by and displayed to conversationparticipants using any of various means of input (e.g., keyboard,stylus, speech recognition, joystick, mouse, touch sensitivity, screenkeyboard, etc.) and any of various means of output, such as a displaydevice (e.g., a liquid crystal display (LCD), a cathode ray tube (CRT)display, projector display, e-ink display, printer, etc.) Theconversation can be framed by the message processing system of anexample embodiment using comic book visual styles (e.g., a plurality ofcomic book-style panels) to draw upon a rich visual language ofexpression. A conversation between networked users can be broken downinto a series of cells in which message panels display the messagecontent conveyed between the networked users. As described in moredetail below, a networked conversation can be embellished in a varietyof ways to enhance the expressive intent, of the networked users andthereby create a more effective form of communication. Examples offraming methods available in the example embodiment include;

-   -   1. Floating frames/panels offset from the default flow    -   2. Text bubbles or message areas that have display baselines        rotated from horizontal    -   3. Separating panels with whitespace    -   4. Using jagged or non-linear panel frames    -   5. Using gradients for panel separation    -   6. Using connecting lines, lightning rods, and animated elements        to emphasize the flow of conversation    -   7. Using display panels of different sizes    -   8. Using avatar images representing participants in the        conversation in panels    -   9. Animating avatar images as part, of the conversation    -   10. Animating the display and/or framing of text as part of the        conversation    -   11. Using props, background/foreground elements, and images as        part of the conversation    -   12. Animating props, background/foreground elements, and images        as part of the conversation    -   13. Storing conversations, contexts, and media for playback        remotely or locally on a display device for later review    -   14. Re-playing animations that were part of the conversation        when participants review previews conversation history    -   15. Separating some elements using visual space to emphasize        something that stands apart    -   16. Separating some elements using frames that overlap to        emphasize things that are connected    -   17. Using visual elements that break outside the bounds of their        container to emphasize action

As described in more detail herein, the embellishments of messages andconversations includes the use of a wide variety of techniques foradding expressive elements to a message or a series of messages. Thesetechniques, as described herein, include the use of avatars, animation,a plurality of comic book-style panels, display objects, shapes,textures, colors, shading, conceptual hints, visual styles, and othertechniques for embellishing a message or a series of messages in aconversation with expressive elements. In one embodiment, messagesand/or conversations can be embellished with 3D avatars with multipleanimated elements, including various expressive backgrounds. In otherembodiments, messages and/or conversations can be embellished byseparating portions of the conversation into comic style panels, withinwhich 3D avatars can be displayed and/or animations can be played.

Referring now to FIG. 5, an illustrated alternative embodiment may usedifferent visual styles. Each separate visual style may use a differentset of conventions—for example, a cinematic movie based embodiment mayuse the conventions or conceptual hints of film noir, whereas acrayon-based, visual style may use conventions or conceptual hints ofchildren's drawings. It is expected that some commercial offerings ofthe various embodiments may specialize in a particular convention tosuit a specific market, and other offerings may provide a choice ofconventions to the users.

For effect, embodiments may animate the old/existing panels and the newpanel as the new panel is added to the conversation. The exampleembodiment uses top-to-down layout based on chronological ordering, withan older panel merging left-to-right in a single cell. Note thattemporal information is provided in each cell. Other layouts may bechosen to support other writing styles (e.g., right-to-left, etc.) aswell as other communication styles (e.g., back-to-front, ordered bydifferent criteria such as sender, subject, visual cues, etc.)

As can be seen in the image shown in FIG. 4, the conversation history isstructured with more recent entries in bigger panels, and entries thatare temporally proximate overlap, whereas there is a more clearseparation to older panels.

Referring now to FIG. 6, the example embodiment illustrates a text boxfor entering messages, a button (e.g., “Send”) to submit/post themessage to the intended recipients, and a button (e.g., ‘smiling face’)to display an emoticon composition user interface having a set ofcontrols to compose more expressive animations/emoticons.

In addition to manual composition of animation-based emoticons, theexample embodiment can also extract meaning through analysis of the textin a current message and/or in a history of the message communications.For example, the text with all capital letters in a message can bedisplayed using a jagged outline to convey exclamatory intent as shownin FIG. 4.

Referring now to FIGS. 7 through 12, the example embodiments illustrateexamples of animated emoticons available in various embodiments. Forexample, FIG. 7 illustrates a “plain” un-adorned presentation image forillustration. FIG. 8 illustrates an animation of question marksemanating out from the conversation participant, first exploding out andthen floating gently out and up. FIG. 9 illustrates three-dimensional(3D) objects (e.g., butterflies) flying out from and interacting withthe participant avatar. FIG. 10 shows a background of hearts addingemotion to the entire display scene, rather than focusing entirely onthe participant avatar. FIG. 11 shows concentric circles radiating outbehind the participant avatar for emphasis (a common comic bookconvention taken to interactive, online animation.) FIG. 12 showsmodifying the entire scene to add drama. For example, the backgroundchanges to one of clouds, there is 3D rain added to the scene elements,and the avatar animates with an expression of shock. In each of theseexamples, various forms of message embellishments or conversationembellishments are used to convey expressive elements of thecommunication between users.

Referring again to FIG. 6, the hearts, clouds, and butterflies displayedin FIGS. 9, 10, and 12 map to corresponding buttons along the bottom rowof the set of controls of the emoticon composition user interface shownin FIG. 6. The circles and question marks displayed in FIGS. 8 and 11map to corresponding buttons found on other pages/tabs of the emoticoncomposition interface.

The example embodiment provides a mechanism (e.g., the compose messageprocessing component 12 described in more detail below) for participantsto discover and purchase additional modes of expression while composinga message. These modes may be as simple as a design for text display, oras complex as a complete scene change, complete with animated 3Dobjects, sound effects, and interaction between participating avatars.These modes of expression may be provided by the operator/provider ofthe message processing system, or may be provided by other third parties(e.g., User-Generated Content), where such third parties may be users ofan embodiment of the message processing system described herein.Purchasing may be made with appropriate value, including but not limitedto, real-world money, earned points or credits, micro-currencies, socialreputation points, bonus and rewards, redeemable tokens, credits cards,debit cards, check, SMS payment, home phone payment, pre-paid cards, andany other mode of payment transaction.

FIG. 13 illustrates, an example of an online catalog listing avataractions or items provided by the compose message processing component 12described below. Any of the actions or items listed in the catalog canbe selected for sampling or purchase using well-known user interfaceinput mechanisms. For each action or item listed in the catalog, a usercan try the action or item, buy the action or item, or gift the actionor item for use by another user. The purchased action or item can beincorporated into an expressive/embellished message (e.g., using theembellish message processing component 14 described in more detailbelow).

As described above, an example embodiment is configured to addexpressive elements to messages or a series of messages (e.g.,conversations) as embellishments of messages or conversations. Theseembellishments can include, among a variety of embellishment techniquesdescribed herein, processing a series of messages to generate acorresponding plurality of comic book-style panels, which embellish theoriginal conversation. As part of this process, an example embodimentcan be configured to receive a series of messages (e.g., a conversation)via a network from one or more other users. The received messages can beconventional text chat messages, instant messages, email messages,Twitter tweets, social network or blog postings, transcribed voicemessages, and/or any of a variety of messages produced by standard textmessaging systems. The received messages can be also be conventionaltext documents, files, news articles, transcribed interviews, and thelike. In general, virtually any type of textual data can be used as asource of the messages provided as an input to the various embodimentsdescribed herein.

In a typical example, the received messages can be conventional textchat messages conveyed between at least two users via a conventionalnetwork. The series of messages conveyed between the two users can beconsidered a conversation. As well-known in conventional text messagingsystems, it can be difficult to capture the intent, mood, tone, emotion,inflection, or subtle meaning of a conversation by use of mere text. Asdescribed above, some users have employed the use of emoticons toattempt to capture the subtleties of a conversation. But thesetechniques can be crude and sometimes annoying.

The various embodiments disclosed herein can embellish a conversation byconverting a series of messages into a corresponding set of comicbook-style panels in a panel layout, which add expressive elements to aconversation and thereby improve communication between the two users. Inone embodiment, a user who is sending a message (e.g., a sending user)can select from a variety of panel layout selections, which conveyvarious types of moods. For example, see FIGS. 7 through 12. In anotherembodiment, the messaging system of an example embodiment can analyzethe message text generated by the sending user (or other source oftextual data) and automatically select an appropriate panel layout fromthe available set of panel layout options without the need for anexplicit user selection of a panel layout. The message text itself canprovide clues that allow the messaging system to select an appropriatepanel layout. For example, a text message presented in the form of aquestion can cause the automatic selection of a panel layout related toa question (e.g., see FIG. 8). In another example, a text messagepresented with various keywords (e.g., ‘sad’, ‘depressed’, etc.) cancause the automatic selection of a panel layout related to a sad ordramatic mood (e.g., see FIG. 12). In another example, a text messagepresented with various keywords (e.g., ‘love’, ‘romance’, etc.) cancause the automatic selection of a panel layout related to a romanticmood (e.g., see FIG. 10). In yet another example, a text messagepresented with various active verbs (e.g., ‘shout’, ‘cry’, etc.) cancause the automatic selection of a panel layout related to an activeresponse (e.g., see FIG. 11). Additionally, other cues in the textmessage itself can be indicative of a particular panel layout selection,such as capitalization, punctuation, emoticons, repeated phrases, etc.Using these techniques, the various embodiments can either explicitly(e.g., user-selected) or implicitly (e.g., automatically selected basedon message content) select a panel layout that corresponds to thereceived message. In this manner, an example embodiment can decide on aninitial panel layout for the display of a newly received message. Oncethe panel layout for the received message is selected as describedabove, the text of the received message can be integrated into aninstance of a panel with the selected panel layout thereby producing amessage panel. The message panel for the newly received message can beadded to previously generated message panels of a related conversationbetween one or more users according to the panel layout (e.g., see FIG.4). The panel layout can be used to determine how the various messagepanels of a conversation fit together. For example, the panel layout candefine a layout wherein message panels are separated with whitespace,the use of jagged or non-linear panel frames, the use of gradients forpanel separation, the use of connecting lines, lightning rods, animatedelements and/or avatars to emphasize the flow of conversation,displaying panels of different sizes, and the like. Other panel layouttechniques are described above. In each case, the message panel layoutcan be used to embellish the conversation between two or more users.

As each message of a conversation is received, the messaging system ofan example embodiment can process the newly received message to addembellishments to the messages and to the conversation as describedabove. In each case, the messaging system can select an appropriatemessage panel for a message and an appropriate panel layout for aconversation using the explicit or implicit methods as described above.In some cases, the newly received message may change the tone of aconversation, which may make a change necessary to the message panelselections or panel layout of previous messages. Therefore, an exampleembodiment compares the panel layout selection for a current messagewith the panel layout selections made for previous messages of aconversation. In this manner, the example embodiment determines arelationship between the current message and previous messages.Similarly, the example embodiment determines a relationship between thecurrently selected panel layout and previously used panel layouts. Basedon this comparison between a current message and previous messages andbetween the currently selected panel layout and previously used panellayouts, the example embodiment can modify the currently selected panel,layout to select a different panel, layout that may more closely matchthe tone reflected in the current message. Similarly, the exampleembodiment can modify a previously used, panel layout to select adifferent panel layout for the previous message that may more closelymatch the tone reflected in the current message. In this case, theprevious message is re-displayed, in a message panel corresponding tothe newly selected different panel layout.

These techniques for selecting a panel layout and subsequently modifyingthe panel layout are beneficial for a variety of reasons. For example,the initial few messages of a conversation can be separated intoseparate panels with white space in between the panels to increasecommunication clarity in the conversation. This separation of messagesinto separate panels can represent one type of panel layout. However, asthe quantity of messages in the conversation increases, it becomesbeneficial to collapse multiple vertical message panels into ahorizontal strip of shorter overlapping message panels to collapse thehistory of the conversation and conserve display area. This collapsingof messages into overlapping message panels can represent a second typeof panel layout. A third type of message panel layout can be used todisplay an embellished conversation in which message panels interactwith each other or objects displayed in the message panels interact witheach other. In each case, the messaging system of an example embodimentcan generate embellished messages and embellished conversations in a aplurality of comic book-style panels in a variety of ways.

In a particular embodiment, the messaging system can: receive, via anetwork, a first message from another user as part of a conversationincluding a plurality of messages; determine an initial panel layout fordisplay of the first message; and display the first message separatedinto a panel corresponding to the initial panel layout.

The particular embodiment of the messaging system can also: receive, viaa network, a second message from another user as part of theconversation; determine a relationship between the first message and thesecond message; select a panel layout for the second message based atleast in part on the relationship between the first message and thesecond message; and display the second message in a panel correspondingto the selected panel layout.

The particular embodiment of the messaging system can also: receive, viaa network, a second message from another user as part of theconversation; determine a relationship between the first message and thesecond message; select a panel layout based at least in part on therelationship between the first message and the second message; displaythe second message in a message panel corresponding to the selectedpanel layout; and re-display the first message in a message panelcorresponding to the selected panel layout.

Once messages are composed and/or embellished as described herein, thetransmission of the messages in a conversation between participants inthe example embodiment can be implemented using any underlyingcommunications medium, including but not limited to SMS, MMS, onlineforums or bulletin boards, email, real-time communications systems suchas IRC, Instant Messenger, telephone, video conversations, existingelectronic discussion systems, speech-to-text and text-to-speechsystems, and embedded conversations in other activities, such as games.“Transmission” as used herein may mean either the sending of a messageto intended destinations, or receiving messages from a source. Thetransmit message processing component 16, described in more detailbelow, manages the transmission of expressive/embellished messages inthe example embodiment.

Additionally, in addition to presenting real-time conversations andpresenting asynchronous conversations, the example embodiment mergesconversations through synchronous and asynchronous means into one streamper context, where context, can correspond to the recipient, sender,subject, time, transmission mode, venue, physical location,user-defined, groupings or filterings, and other criteria.

In an example embodiment of the message processing system as describedherein, several processes can be used to compose, embellish, and delivera message with increased clarity and expressiveness. Additionally,several other processes can be used to receive, display, and browsemessages with embellished properties. These processes in an exampleembodiment are listed and described below:

-   -   1. The process of selecting recipients and/or context for the        message/s (see FIG. 14)    -   2. The process of composing messages (see FIG. 15 and the        Compose Message Processing component 12 shown, in FIGS. 22 and        23)    -   3. The process of embellishing messages (see FIG. 16 and the        Embellish Message Processing component 14 shown in FIGS. 22 and        23)    -   4. The process of transmitting, storing, and forwarding messages        to recipient's (see FIG. 17 and the Transmit Message Processing        component 16 shown in FIGS. 22 and 23)    -   5. The process of receiving messages (see FIG. 18 and the        Receive Message Processing component 17 shown in FIGS. 22 and        23)    -   6. The process of displaying received messages (see FIG. 19 and        the Display Message Processing component 18 shown in FIGS. 22        and 23) in context, of other messages (see FIG. 20)    -   7. The process of browsing and (re-)reviewing messages (see FIG.        21 and the Browse Message Processing component 22 shown in FIGS.        22 and 23)

Note that the sequence of user actions in time can vary from thesequence specified above. For example, a message may be composed beforerecipients are chosen.

Messages can be transmitted through a variety of channels as mentionedabove. Some of those channels may be “embellishment capable,” meaningthat the channels can carry information about user embellishments withrich fidelity. Examples include extended Extensible Mark-up Language(XML) elements in Extensible Messaging and Presence Protocol (XMPP)transports, using Java Script Object Notation (JSON) or Javascriptencoding for additional data in Hypertext Markup Language (HTML)display, or using attachments to e-mail messages or MultipurposeInternet Mail Extensions (MIME)/multipart encoding for carryingembellishment information.

When messages are transmitted to a channel that is notembellishment-aware, embellishments to messages are “down-converted” totraditional text representations. For example, an animation of flyinghearts may be converted to the text emoticon “<3” and an animation of agrinning avatar may be converted to the text emoticon “:-D” This way,some of the emotion of the original message is conveyed even though thefull richness is lost.

When messages are received without embellishment information,embellishments can be added on the receiving side in a process analogousto the reverse of the “down-converting” of embellishments. This makesmessages more impactful when viewed through this particularcommunication mechanism than when viewed in a traditional text medium,even though the full richness of embellishments is not present.

The example embodiment can be implemented as a sequence of instructionsstored on a communications device containing a central processing unitwith a connection to a display, as well as a mechanism of Input. Invariants of the example embodiment, input consists of a touch-screenwith an available on-screen keyboard, and a traditional PersonalComputer (PC) keyboard and mouse interface. The example embodiment canbe configured to transmit and receive communications through third-partycommunication channels such as Google Talk or Twitter. The exampleembodiment can also be configured to transmit and receive communicationsthrough a communication channel with knowledge about the embellishmentor expressive data, built on top of a message system as described inU.S. patent application Ser. No. 13/019,505, filed on Feb. 2, 2011 orU.S. Pat. No. 7,995,064 filed by the same applicant as the presentapplication.

In the example embodiments described below, a user/participant canselect a set of message recipients and compose a message includingexplicitly user-selected message embellishments and/or system-providedor automatically generated message embellishments. When a user hascompleted the configuration of an embellished message, the participantcan press the “Send” or “Post” button to submit the message to themessage processing system for further processing.

Referring to FIG. 14, the process of selecting recipients and/or contextfor the message/s in an example embodiment is illustrated.

Referring to FIG. 15, the process of composing messages in an exampleembodiment is illustrated.

Referring to FIG. 16, the process of embellishing messages in an exampleembodiment is illustrated.

Referring to FIG. 17, the process of transmitting, storing, andforwarding messages to recipient/s in an example embodiment isillustrated.

Referring to FIG. 18, the process of receiving messages in an exampleembodiment is illustrated.

Referring to FIGS. 19 and 20, the process of displaying receivedmessages (see FIG. 19) in the context of other messages (see FIG. 20) inan example embodiment is illustrated.

Referring to FIG. 21, the process of browsing and (re-)reviewingmessages in an example embodiment is illustrated.

In the example embodiments described herein, embellishments arerepresented as references to rich data separately available on acomputer network. References can go several levels deep, and may makeuse of a proportional-compensation mechanism for e-commerce, such as thesystem and method described in U.S. Pat. No. 7,912,793, filed by thesame applicant as the present application.

The display device can store some needed data for embellishment displaylocally, and can fetch other needed components from a remote storagesystem. That remote storage system may use information about therequest, such as the requesting user, the message being viewed, and thespecific assets, to make a determination on whether the requested assetshould be transmitted to the user, or whether that request should bedenied, for example because of non-payment or regulatory compliance.Embellishments consist of one set of data stored on such systems anddistributed to viewable clients (called “embellishment data,”) andanother set of data, called “configuration data,” that is actuallytransmitted with the message through the embellishment-awaretransmission channel. Properties that can be configured for theembellishment may include such values as start time, duration, targetavatar, flight path of effects, colors to use, speed, volume, andinclusion/exclusion of specific components of the embellishment.

The embellishment data contains information about which configurationparameters are available for the particular embellishment. Once amessage with one or more embellishments has been composed andtransmitted, the receiving display device additionally makes use of(e.g., decodes) the description of the embellishment data to display theembellishment in different modes as shown in the flow charts illustratedin FIGS. 19 and 20.

Examples of embellishment data include references to specific textureimages, specific mesh data, specific animation data including but notlimited to position, orientation, scale, and shape of geometric objectsin the displayed scene/panel, sound effects, timing information, as wellas groupings of elements that may be configured or included/excluded inthe transmitted embellishment. An additional piece of data in theembellishment data is information about how to translate theembellishment to text-mode representation, and how to recognize aninstance of the embellishment and certain configuration data in receivedtext-mode messages. For example, a flying-hearts embellishment maycontain instructions that the presence of the text-mode emoticon. “<3”instantiates this embellishment for display, and that the number of suchemoticons found in a particular message modulates the “number of hearts”configuration data of the embellishment.

Other examples of embellishment data include whether to change the moodof the sending or receiving avatar elements of the display panel. Forexample, the “sad” embellishment may instruct the display device toapply a “sad face” and “hanging head” animation to the sending userrepresentation avatar.

Thus, as described above, the various embodiments can convert anon-embellished message into an embellished message. Similarly, thevarious embodiments can convert an embellished message into anon-embellished message. As a result, the various embodiments canreceive message streams from a variety of sources (e.g., Twitter) andapply or modify embellishments as needed to convert the message to aformat compatible with a particular output mode. For output systemscapable of supporting fully embellished messages (e.g., animation,avatars, texture graphics, etc.), the various embodiments can processthe received message in any form to produce a fully embellished message.As described above, the fully embellished message adds communicationelements and nuances not available in conventional text messages.Nevertheless, for output systems not capable of or not configured forsupporting fully embellished messages, the various embodiments canprocess the received message in any form to produce a non-embellishedmessage, while still trying to convey the meaning of the embellishmentsbut using non-embellished messaging techniques as described above.

The various embodiments as described herein provide several advantages,improvements, and benefits over the conventional technologies. A few ofthese advantages are listed below;

-   -   The various embodiments described herein can use the same        presentation form for either synchronous or asynchronous chat.    -   The various embodiments described herein can represent        participants using customizable 3D avatars.    -   The various embodiments described herein can represent emotion        using animations in the context of the particular message.    -   The various embodiments described herein can provide intrinsic        monetization opportunities that are integral (as opposed to        external) to the experience.    -   The various embodiments described herein allow subsequent review        of animation-based emoticons and participants in the original        context.    -   The various embodiments described herein can structure        conversation history in a manner that frames the situation of        the communication.

It will be apparent to those of ordinary skill in the art that thevarious embodiments as described herein can provide other advantages,improvements, and benefits over the conventional technologies.

Referring now to FIG. 22, in an example embodiment, a system and methodfor increasing clarity and expressiveness in network communications aredisclosed. In various example embodiments, an application or service,typically operating on a host site (e.g., a website) 110, is provided tosimplify and facilitate synchronous or asynchronous message and statetransfers between a plurality of users at user platforms 140 from thehost site 110. The host, site 110 can thereby be considered a messageprocessing system site 110 as described herein. Multiple user platforms140 provide a plurality of message streams of which a user may become acontent consumer and/or a content provider. The message processingsystem site 110 and the user platforms 140 may communicate and transfermessages, related content, and information via a wide area data network(e.g., the Internet) 120. Various components of the message processingsystem site 110 can also communicate internally via a conventionalintranet or local area network (LAN) 114.

Networks 120 and 114 are configured to couple one computing device withanother computing device. Networks 120 and 114 may be enabled to employany form of computer readable media for communicating information fromone electronic device to another. Network 120 can include the Internetin addition to LAN 114, wide area networks (WANs), direct connections,such as through a universal serial bits (USB) port, other forms ofcomputer-readable media, or any combination thereof. On aninterconnected set of LANs, including those based on differingarchitectures and protocols, a router acts as a link between LANs,enabling messages to be sent between computing devices. Also,communication links within LANs typically include twisted wire pair orcoaxial cable, while communication links between networks may utilizeanalog telephone lines, full or fractional dedicated digital linesincluding T1, T2, T3, and T4, Integrated Services Digital Networks(ISDNs), Digital User/Subscriber Lines (DSLs), wireless links includingsatellite links, or other communication links known to those of ordinaryskill in the art. Furthermore, remote computers and other relatedelectronic devices can be remotely connected to either LANs or WANs viaa modem and temporary telephone link.

Networks 120 and 114 may further include any of a variety of wirelesssub-networks that may further overlay stand-alone ad-hoc networks, andthe like, to provide an infrastructure-oriented connection. Suchsub-networks may include mesh networks. Wireless LAN (WLAN) networks,cellular networks, and the like. Networks 120 and 114 may also includean autonomous system of terminals, gateways, routers, and the likeconnected by wireless radio links or wireless transceivers. Theseconnectors may be configured to move freely and randomly and organizethemselves arbitrarily, such that the topology of networks 120 and 114may change rapidly.

Networks 120 and 114 may further employ a plurality of accesstechnologies including 2nd (2G), 2.5, 3rd (3G), 4th (4G) generationradio access for cellular systems, wireless local area network (WLAN),Wireless Router (WR) mesh, and the like. Access technologies such as 2G,3G, 4G, and future access networks may enable wide area coverage formobile devices, such as one or more of client devices 141, with variousdegrees of mobility. For example, networks 120 and 114 may enable aradio connection through a radio network access such as Global Systemfor Mobile communication (GSM), General Packet Radio Services (GPRS),Enhanced Data GSM Environment (EDGE), Wideband Code Division MultipleAccess (WCDMA), CDMA2000, and the like. Networks 120 and 114 may also beconstructed for use with various other wired and wireless communicationprotocols, including TCP/IP, UDP, SIP, SMS, RTP, WAP, CDMA, TDMA, EDGE,UMTS, GPRS, GSM, LTE, UWB, WiMax, IEEE 802.11x, and the like. Inessence, networks 120 and 114 may include virtually any wired and/orwireless communication mechanisms by which information may travelbetween one computing device and another computing device, network, andthe like. In one embodiment, network 114 may represent a LAN that isconfigured behind a firewall (not shown), within a business data center,for example.

The user platforms 140 may include any of a variety of providers ofnetwork transportable digital content. Typically, the file format thatis employed is XML, however, the various embodiments are not so limited,and other file formats may be used. For example, feed formats other thanHTML/XML or formats other than open/standard feed formats can besupported by various embodiments. Any electronic file format, such asPortable Document Format (PDF), audio (e.g., Motion Picture ExpertsGroup Audio Layer 3—MP3, and the like), video (e.g., MP4, and the like),and any proprietary interchange format defined by specific content sitescan be supported by the various embodiments described herein. Syndicatedcontent includes, but is not limited to such content as news feeds,events listings, news stories, blog content, headlines, project updates,excerpts from discussion forums, business or government information, andthe like. As used, throughout this application, including the claims,the term “feed,” sometimes called a channel, refers to any mechanismthat enables content access from a user platform 140.

In a particular embodiment, a user platform 140 with one or more clientdevices 141 enables a user to access content from other user platforms140 via the message processing system site 110 and network 120. Clientdevices 141 may include virtually any computing device that isconfigured to send and receive information over a network, such asnetwork 120. Such client devices 141 may include portable devices 144 or146 such as, cellular telephones, smart phones, display pagers, radiofrequency (RF) devices, infrared (IR) devices, global positioningdevices (GPS), Personal Digital Assistants (PDAs), handheld computers,wearable computers, tablet computers, integrated devices combining oneor more of the preceding devices, and the like. Client devices 141 mayalso include other computing devices, such as personal computers 142,multiprocessor systems, microprocessor-based or programmable consumerelectronics, network PC's, set-top boxes, and the like. As such, clientdevices 141 may range widely in terms of capabilities and features. Forexample, a client device configured, as a cell phone may have a numerickeypad and a few lines of monochrome LCD display on which, only text maybe displayed. In another example, a web-enabled client device may have atouch sensitive screen, a stylus, and several lines of color LCD displayin which both text and graphics may be displayed. Moreover, theweb-enabled client device may include a browser application enabled toreceive and to send wireless application protocol messages (WAP), and/orwired application messages, and the like. In one embodiment, the browserapplication is enabled to employ HyperText Markup Language (HTML),Dynamic HTML, Handheld Device Markup Language (HDML), Wireless MarkupLanguage (WML), WMLScript, JavaScript, Extensible HTML (xHTML), CompactHTML (CHTML), and the like, to display and send a message.

Client devices 141 may also include at least one client application thatis configured to receive content or messages from another computingdevice via a network transmission. The client application may include acapability to provide and receive textual content, graphical content,video content, audio content, alerts, messages, notifications, and thelike. Moreover, client devices 141 may be further configured tocommunicate and/or receive a message, such as through a Short MessageService (SMS), direct messaging (e.g., Twitter), email. MultimediaMessage Service (MMS), instant messaging (IM), internet relay chat(IRC), mIRC, Jabber, Enhanced Messaging Service (EMS), text messaging.Smart Messaging, Over the Air (OTA) messaging, or the like, betweenanother computing device, and the like.

Client devices 141 may also include a wireless application device 148 onwhich a client application is configured to enable a user of the deviceto subscribe to at least one message source. Such subscription enablesthe user at user platform 140 to receive through the client, device 141at least a portion of the message content. Such content may include, butis not limited, to, instant messages, Twitter tweets, posts, stockfeeds, news articles, personal advertisements, shopping list prices,images, search results, blogs, sports, weather reports, or the like.Moreover, the content may be provided to client devices 141 using any ofa variety of delivery mechanisms, including IM, SMS, Twitter, Facebook,MMS, IRC, EMS, audio messages, HTML, email, or another messagingapplication. In a particular embodiment, the application executable codeused for content subscription as described herein can itself bedownloaded to the wireless application device 148 via network 120.

In some cases, a user at user platform 140 can subscribe to certaincontent and/or content channels provided by all mechanisms available onthe client device(s) 141. In various embodiments described herein, thehost site 110 can employ processed information to deliver contentchannel information to the user using a variety of delivery mechanisms.For example, content channel information can be delivered to a user viaemail. Short Message Service (SMS), wireless applications, and directmessaging (e.g., Twitter) to name a few. Additionally, content channelinformation can be provided to a user in response to a request from theuser.

Referring still to FIG. 22, host site 110 of an example embodiment isshown to include a message processing system 200, intranet 114, andmessage processing system database 105. Message processing system 200can also include a Compose Message Processing component 12, an EmbellishMessage Processing component 14, a Transmit Message Processing component16, a Receive Message Processing component 17, a Display MessageProcessing component 18, and a Browse Message Processing component 22.Each of these modules can be implemented as software componentsexecuting within an executable environment of message processing system200 operating on host site 110. Each of these modules of an exampleembodiment is described in more detail above in connection with thefigures provided herein.

Referring now to FIG. 23, another example embodiment 101 of a networkedsystem in which various embodiments may operate is illustrated, in theembodiment illustrated, the host site 110 is shown to include themessage processing system 200. The message processing system 200 isshown to include the functional components 12 through 22 as describedabove. In a particular embodiment, the host site 110 may also include aweb server 904, having a web interface with which users may interactwith the host site 110 via a user interface or web interface. The hostsite 110 may also include an application programming interface (API) 902with which the host site 110 may interact with other network entities ona programmatic or automated data transfer level. The API 902 and webinterface 904 may be configured to interact with the message processingsystem 200 either directly or via an interface 906. The messageprocessing system 200 may be configured to access a data storage device105 either directly or via the interface 906.

FIGS. 24 and 25 are processing flow diagrams illustrating an exampleembodiment of a message processing system as described herein. Referringto FIG. 24, the method of an example embodiment includes: obtaining amessage from a first user as part of a network-enabled conversation witha second user (processing block 1010); applying at least oneembellishment to the message to produce an embellished message, theembellishment including either an explicitly user-selected embellishmentor an automatically generated embellishment based on content of themessage (processing block 1020); and causing transmission of theembellished message via a network to the second user (processing block1030).

Referring to FIG. 25, example embodiments include: receiving a messagefrom a first user via a network (processing block 1040); determining ifthe message includes configuration data for configuring embellishmentproperties of the message (processing block 1050); if the messageincludes configuration data for configuring embellishment properties ofthe message, decoding the configuration data and generating anembellished message with the corresponding embellishment properties(processing block 1060); if the message does not include configurationdata for configuring embellishment properties of the message,automatically generating embellishment, properties based on content ofthe message and generating an embellished message with the correspondingembellishment properties (processing block 1070); and displaying theembellished message for the second user as part of a network-enabledconversation with the first user (processing block 1080).

FIG. 26 shows a diagrammatic representation of machine in the exampleform of a computer system 700 within which a set of instructions whenexecuted may cause the machine to perform any one or more of themethodologies discussed herein. In alternative embodiments, the machineoperates as a standalone device or may be connected (e.g., networked) toother machines. In a networked deployment, the machine may operate inthe capacity of a server or a client machine in server-client networkenvironment, or as a peer machine in a peer-to-peer (or distributed)network environment. The machine may be a personal computer (PC), atablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), acellular telephone, a web appliance, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. Further,while only a single machine is illustrated, the term “machine” can alsobe taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions to perform anyone or more of the methodologies discussed herein.

The example computer system 700 includes a data processor 702 (e.g., acentral processing unit (CPU), a graphics processing unit (GPU), orboth), a main memory 704 and a static memory 706, which communicate witheach other via a bus 708. The computer system 700 may further include avideo display unit 710 (e.g., a liquid crystal display (LCD) or acathode ray tube (CRT)). The computer system 700 also includes an inputdevice 712 (e.g., a keyboard), a cursor control device 714 (e.g., amouse), a disk drive unit 716, a signal generation device 718 (e.g., aspeaker) and a network interface device 720.

The disk drive unit 716 includes a non-transitory machine-readablemedium 722 on which is stored one or more sets of instructions (e.g.,software 724) embodying any one or more of the methodologies orfunctions described herein. The instructions 724 may also reside,completely or at least partially, within the main memory 704, the staticmemory 706, and/or within the processor 702 during execution thereof bythe computer system 700. The main memory 704 and the processor 702 alsomay constitute machine-readable media. The instructions 724 may furtherbe transmitted or received over a network 726 via the network interfacedevice 720. While the machine-readable medium 722 is shown in an exampleembodiment to be a single medium, the term “machine-readable medium”should be taken to include a single non-transitory medium or multiplemedia (e.g., a centralized or distributed database, and/or associatedcaches and servers) that store the one or more sets of instructions. Theterm “machine-readable medium” can also be taken to include anynon-transitory medium, or combination of transitory media collaboratingto create a non-transitory or semi-non-transitory medium, that iscapable of storing, encoding or carrying a set of instructions forexecution by the machine and that cause the machine to perform any oneor more of the methodologies of the various embodiments, or that, iscapable of storing, encoding or carrying data structures utilized by orassociated with such a set of instructions. The term “machine-readablemedium” can accordingly be taken to include, but not be limited to,solid-state memories, optical media, and magnetic media.

The Abstract of the Disclosure is provided to comply with 37 C.F.R.§1.72(b), requiring an abstract that will allow the reader to quicklyascertain the nature of the technical disclosure. It is submitted withthe understanding that it will not be used to interpret or limit thescope or meaning of the claims. In addition, in the foregoing DetailedDescription, it can be seen that various features are grouped togetherin a single embodiment for the purpose of streamlining the disclosure.This method of disclosure is not to be interpreted as reflecting anintention that the claimed embodiments require more features than areexpressly recited in each claim. Rather, as the following claimsreflect, inventive subject matter lies in less than all features of asingle disclosed embodiment. Thus the following claims are herebyincorporated into the Detailed Description, with each claim standing onits own as a separate embodiment.

What is claimed is:
 1. A method comprising: obtaining a message from afirst user as part of a network-enabled conversation with a second user,the conversation having a plurality of associated messages; analyzing,by use of a processor, the content of the message; automaticallyselecting a panel layout based on the content of the message, the panellayout defining a consistent set of expressive elements for theplurality of messages associated with the conversation, the panel layoutfurther defining a plurality of panels for presenting a series of themessages of the conversation with the expressive elements; integratingthe message into at least one of the plurality of panels with theexpressive elements; automatically selecting at least one embellishmentfrom an available set of embellishment options based on the selectedpanel layout; applying, by use of the processor, the automaticallyselected at least one embellishment to the message to produce anembellished message with configuration data encoded therewithcorresponding to the at least one embellishment, the configuration dataincluding a plurality of data values defining particular embellishmentproperties of the at least one embellishment; and causing transmissionof the embellished message via a network to the second user.
 2. Themethod as claimed in claim 1 including enabling the first user tocompose the message.
 3. The method as claimed in claim 1 includingenabling the first user to purchase an embellishment and applying theuser-purchased embellishment to the message.
 4. The method as claimed inclaim 1 including displaying a catalog of embellishments for purchase bythe first user.
 5. A method comprising: receiving a message from a firstuser via a network, the message being part of a network-enabledconversation with a second user, the conversation having a plurality ofassociated messages; determining if the message includes configurationdata for configuring embellishment properties of the message; if themessage includes configuration data for configuring embellishmentproperties of the message, decoding, by use of a processor, theconfiguration data and generating an embellished message with thecorresponding embellishment properties; if the message does not includeconfiguration data for configuring embellishment properties of themessage, analyzing the content of the message, automatically selecting apanel layout based on the content of the message, the panel layoutdefining a consistent set of expressive elements for the plurality ofmessages associated with the conversation, the panel layout furtherdefining a plurality of panels for presenting a series of the messagesof the conversation with the expressive elements, integrating themessage into at least one of the plurality of panels with the expressiveelements, automatically generating embellishment properties based on theselected panel layout, and generating an embellished message with thecorresponding automatically generated embellishment properties; anddisplaying the plurality of panels of the conversation including theembellished message with the expressive elements for the second user aspart of the conversation with the first user.
 6. The method as claimedin claim 5 including enabling the second user to browse messages of theconversation.
 7. The method as claimed in claim 5 wherein theembellishment properties include an avatar.
 8. The method as claimed inclaim 5 wherein the embellishment properties include instructions toanimate an avatar.
 9. The method as claimed in claim 5 wherein thereceived message is a non-embellished message received from a sender.10. The method as claimed in claim 5 wherein the conversation isdisplayed to the first and second users as the plurality of panels withthe expressive elements presented in a plurality of comic book-stylepanels.
 11. A system comprising: a data processor; a network connection,in data communication with the processor, for access to a network; and amessage processing system, executable by the processor, to: obtain amessage from a first user as part of a network-enabled conversation witha second user, the conversation having a plurality of associatedmessages; analyze the content of the message; automatically select apanel layout based on the content of the message, the panel layoutdefining a consistent set of expressive elements for the plurality ofmessages associated with the conversation, the panel layout furtherdefining a plurality of panels for presenting a series of the messagesof the conversation with the expressive elements; integrate the messageinto at least one of the plurality of panels with the expressiveelements; automatically select at least one embellishment from anavailable set of embellishment options based on the selected panellayout; apply the automatically selected at least one embellishment tothe message to produce an embellished message with configuration dataencoded therewith corresponding to the at least one embellishment, theconfiguration data including a plurality of data values definingparticular embellishment properties of the at least one embellishment;and cause transmission of the embellished message via a network to thesecond user.
 12. The system as claimed in claim 11 being furtherconfigured to enable the first user to compose the message.
 13. Thesystem as claimed in claim 11 being further configured to enable thefirst user to purchase an embellishment and applying the user-purchasedembellishment to the message.
 14. The system as claimed in claim 11being further configured to display a catalog of embellishments forpurchase by the first user.
 15. A system comprising: a data processor; anetwork connection, in data communication with the processor, for accessto a network; and a message processing system, executable by theprocessor, to: receive a message from a first user via a network, themessage being part of a network-enabled conversation with a second user,the conversation having a plurality of associated messages; determine ifthe message includes configuration data for configuring embellishmentproperties of the message; if the message includes configuration datafor configuring embellishment properties of the message, decode theconfiguration data and generate an embellished message with thecorresponding embellishment properties; if the message does not includeconfiguration data for configuring embellishment properties of themessage, analyze the content of the message, automatically select apanel layout based on the content of the message, the panel layoutdefining a consistent set of expressive elements for the plurality ofmessages associated with the conversation, the panel layout furtherdefining a plurality of panels for presenting a series of the messagesof the conversation with the expressive elements, integrate the messageinto at least one of the plurality of panels with the expressiveelements, automatically generate embellishment properties based on theselected panel layout, and generate an embellished message with thecorresponding automatically generated embellishment properties; anddisplay the plurality of panels of the conversation including theembellished message with the expressive elements for the second user aspart of the conversation with the first user.
 16. The system as claimedin claim 15 being further configured to enable the second user to browsemessages of the conversation.
 17. The system as claimed in claim 15wherein the embellishment properties include an avatar.
 18. The systemas claimed in claim 15 wherein the embellishment properties includeinstructions to animate an avatar.
 19. The system as claimed in claim 15wherein the received message is a non-embellished message received froma sender.
 20. The system as claimed in claim 15 wherein the conversationis displayed to the first and second users as the plurality of panelswith the expressive elements presented in a plurality of comicbook-style panels.
 21. A non-transitory machine-useable storage mediumembodying instructions which, when executed by a machine, cause themachine to: obtain a message from a first user as part of anetwork-enabled conversation with a second user, the conversation havinga plurality of associated messages; analyze the content of the message;automatically select a panel layout based on the content of the message,the panel layout defining a consistent set of expressive elements forthe plurality of messages associated with the conversation, the panellayout further defining a plurality of panels for presenting a series ofthe messages of the conversation with the expressive elements; integratethe message into at least one of the plurality of panels with theexpressive elements; automatically select at least one embellishmentfrom an available set of embellishment options based on the selectedpanel layout; apply the automatically selected at least oneembellishment to the message to produce an embellished message withconfiguration data encoded therewith corresponding to the at least oneembellishment, the configuration data including a plurality of datavalues defining particular embellishment properties of the at least oneembellishment; and cause transmission of the embellished message via anetwork to the second user.
 22. A non-transitory machine-useable storagemedium embodying instructions which, when executed by a machine, causethe machine to: receive a message from a first user via a network, themessage being part of a network-enabled conversation with a second user,the conversation having a plurality of associated messages; determine ifthe message includes configuration data for configuring embellishmentproperties of the message; if the message includes configuration datafor configuring embellishment properties of the message, decode theconfiguration data and generate an embellished message with thecorresponding embellishment properties; if the message does not includeconfiguration data for configuring embellishment properties of themessage, analyze the content of the message, automatically select apanel layout based on the content of the message, the panel layoutdefining a consistent set of expressive elements for the plurality ofmessages associated with the conversation, the panel layout furtherdefining a plurality of panels for presenting a series of the messagesof the conversation with the expressive elements, integrate the messageinto at least one of the plurality of panels with the expressiveelements, automatically generate embellishment properties based on theselected panel layout, and generate an embellished message with thecorresponding automatically generated embellishment properties; anddisplaying the plurality of panels of the conversation including theembellished message with the expressive elements for the second user aspart of the conversation with the first user.
 23. A system comprising: adata processor; a network connection, in data communication with theprocessor, for access to a network; and a message processing system,executable by the processor, to: receive, via a network, a first messagefrom a user as part of a conversation including a plurality of messages;determine if the first message includes configuration data encodedtherewith for configuring embellishment properties of the first message,the configuration data including a plurality of data values definingparticular embellishment properties of the first message; analyze thecontent of the first message; automatically determine an initial panellayout for display of the first message based on the content of thefirst message, the panel layout defining a consistent set of expressiveelements for the plurality of messages associated with the conversation,the panel layout further defining a plurality of panels for presenting aseries of the messages of the conversation with the expressive elements,integrate the first message into at least one of the plurality of panelswith the expressive elements; and present the plurality of panels of theconversation including the first message with the expressive elements.24. The system as claimed in claim 23 being further configured to:receive, via the network, a second message from another user as part ofthe conversation; determine a relationship between the first message andthe second message; select a panel layout for the second message basedat least in part on the relationship between the first message and thesecond message; and present the second message in a message panel of theplurality of panels of the conversation with the expressive elementscorresponding to the selected panel layout.
 25. The system as claimed inclaim 23 being further configured to: receive, via the network, a secondmessage from another user as part of the conversation; determine arelationship between the first message and the second message; select apanel layout based at least in part on the relationship between thefirst message and the second message; present the second message in amessage panel of the plurality of panels of the conversation with theexpressive elements corresponding to the selected panel layout; andpresent the first message in a message panel of the plurality of panelsof the conversation with the expressive elements corresponding to theselected panel layout.
 26. The method as claimed in claim 1 includingenabling the first user to compose the message and to view the messageas included in the plurality of panels of the conversation with theexpressive elements that will appear to the second user prior totransmission of the message to the second user.
 27. A method comprising:obtaining a message from a first user as part of a network-enabledconversation with a second user, the conversation having a plurality ofassociated messages; determining a panel layout, the panel layoutdefining a consistent set of expressive elements for the plurality ofmessages associated with the conversation, the panel layout furtherdefining a plurality of panels for presenting a series of the messagesof the conversation with the expressive elements; integrating themessage into at least one of the plurality of panels with the expressiveelements; enabling the first user to purchase an embellishment;applying, by use of the processor, the user-purchased embellishment tothe message to produce an embellished message with configuration dataencoded therewith corresponding to the user-purchased embellishment, theconfiguration data including a plurality of data values definingparticular embellishment properties of the at least one embellishment;and causing transmission of the embellished message via a network to thesecond user.
 28. The method as claimed in claim 27 including enablingthe first user to compose the message and to view the embellishedmessage as the embellished message will appear to the second user priorto transmission of the embellished message to the second user.
 29. Themethod as claimed in claim 27 including enabling the first user toexplicitly apply the user-purchased embellishment to the message.